Emulating a computer run time environment

ABSTRACT

Emulating a computer run time environment including: storing translated code in blocks of a translated code cache, each block of the translated code cache designated for storage of translated code for a separate one of the target executable processes, including identifying each block in dependence upon an identifier of the process for which the block is designated as storage; executing by the emulation environment a particular one of the target executable processes, using for target code translation the translated code in the block of the translated code cache designated as storage for the particular process; and upon encountering a context switch by the target operating system to execution of a new target executable process, changing from the block designated for the particular process to using for target code translation the translated code in the block of the translated code cache designated as storage for the new target executable process.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The field of the invention is data processing, or, more specificallymethods, apparatus, and products for emulating a computer run timeenvironment.

2. Description of Related Art

The development of the EDVAC computer system of 1948 is often cited asthe beginning of the computer era. Since that time, computer systemshave evolved into extremely complicated devices. Today's computers aremuch more sophisticated than early systems such as the EDVAC. Computersystems typically include a combination of hardware and softwarecomponents, application programs, operating systems, processors, buses,memory, input/output devices, and so on. As advances in semiconductorprocessing and computer architecture push the performance of thecomputer higher and higher, more sophisticated computer software hasevolved to take advantage of the higher performance of the hardware,resulting in computer systems today that are much more powerful thanjust a few years ago.

As computer systems advance, software designed to run on older computersystems is increasingly more difficult and sometimes impossible toexecute natively on the more advanced computer systems. One way toexecute computer software on a computer system for which the computersoftware was not intended to run is to emulate, that is, imitate, thecomputer system for which the computer software was intended to run onthe computer system for which the computer software was not indented torun. Current methods of emulating computer systems, however, are ofteninefficient.

SUMMARY OF THE INVENTION

Methods, apparatus, and products for emulating a computer run timeenvironment, the emulating implemented as a component of a dynamicbinary translation loop that operates in an emulation environment totranslate target executable code compiled for execution on a targetcomputer to translated code executable on a host computer of a kindother than the target computer, where the target executable codeincludes user-level application code and target operating system code,the target executable code also includes target executable processes,and the target operating system code effects context switches among thetarget executable processes. Emulating a computer run time environmentin accordance with embodiments of the present invention includes:storing translated code in blocks of a translated code cache, each blockof the translated code cache designated for storage of translated codefor a separate one of the target executable processes, includingidentifying each block in dependence upon an identifier of the processfor which the block is designated as storage; executing by the emulationenvironment a particular one of the target executable processes, usingfor target code translation the translated code in the block of thetranslated code cache designated as storage for the particular process;and upon encountering a context switch by the target operating system toexecution of a new target executable process, changing from the blockdesignated for the particular process to using for target codetranslation the translated code in the block of the translated codecache designated as storage for the new target executable process.

The foregoing and other objects, features and advantages of theinvention will be apparent from the following more particulardescriptions of exemplary embodiments of the invention as illustrated inthe accompanying drawings wherein like reference numbers generallyrepresent like parts of exemplary embodiments of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 sets forth a block diagram of automated computing machinerycomprising an exemplary computer useful in emulating a computer run timeenvironment according to embodiments of the present invention.

FIG. 2 sets forth a functional block diagram of an example apparatususeful in emulating a computer run time environment according toembodiments of the present invention.

FIG. 3 sets forth a functional block diagram of a further exampleapparatus useful in emulating a computer run time environment accordingto embodiments of the present invention.

FIG. 4 sets forth a flow chart illustrating an exemplary method for dataprocessing with an example apparatus useful in emulating a computer runtime environment according to embodiments of the present invention.

FIG. 5 sets forth a block diagram of an exemplary computing environmentuseful for emulating a computer run time environment according toembodiments of the present invention.

FIG. 6 sets forth a flow chart illustrating an exemplary method foremulating a computer run time environment according to embodiments ofthe present invention.

DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS

Exemplary apparatus and methods for data processing with a NOC inaccordance with the present invention are described with reference tothe accompanying drawings, beginning with FIG. 1. FIG. 1 sets forth ablock diagram of automated computing machinery comprising an exemplarycomputer (152) useful in emulating a computer run time environmentaccording to embodiments of the present invention. The computer (152) ofFIG. 1 includes at least one computer processor (156) or ‘CPU’ as wellas random access memory (168) (‘RAM’) which is connected through a highspeed memory bus (166) and bus adapter (158) to processor (156) and toother components of the computer (152).

Stored in RAM (168) is a host application program (184), a module ofuser-level computer program instructions for carrying out particulardata processing tasks such as, for example, word processing,spreadsheets, database operations, video gaming, stock marketsimulations, atomic quantum process simulations, or other user-levelapplications. Also stored in RAM (168) is a host operating system (154).Operating systems useful for emulating a computer run time environmentaccording to embodiments of the present invention include UNIX™, Linux™,Microsoft XP™, AIX™, IBM's i5/OS™, and others as will occur to those ofskill in the art. The operating system (154) and the application (184)in the example of FIG. 1 are shown in RAM (168), but many components ofsuch software typically are stored in non-volatile memory also, such as,for example, on a disk drive (170).

Also stored in RAM (168) is an emulated computer run time environment inwhich target executable code (504) is translated by a binary translationloop (502) and executed. The binary translation loop (502) and emulationenvironment (206) operate generally for emulating a computer run timeenvironment in accordance with embodiments of the present invention. Thebinary translation loop (502) is a module of computer programinstructions that operates in an emulation environment (206) totranslate target executable code (504) compiled for execution on atarget computer to translated code executable on a host computer (152)of a kind other than the target computer. Such target executable code(504) includes user-level application code (606) and target operatingsystem code (604). The target executable code (504) also includes targetexecutable processes (602) with the target operating system code (504)effecting context switches among the target executable processes (602).

The binary translation loop (502) also includes computer programinstructions capable of storing translated code in blocks (612) of atranslated code cache (610), with each block (612) of the translatedcode cache (610) designated for storage of translated code for aseparate one of the target executable processes (602). Storingtranslated code in blocks (612) of a translated code cache (610)includes identifying, by the binary translation loop (502), each block(612) in dependence upon an identifier of the process (602) for whichthe block (612) is designated as storage.

The emulation environment (206) is another module of computer programinstructions useful for emulating a computer run time environment inaccordance with embodiments of the present invention. The emulationenvironment (206) includes computer program instructions capable ofexecuting a particular one of the target executable processes (602),using for target code translation the translated code in the block ofthe translated code cache designated as storage for the particularprocess; and upon encountering a context switch by the target operatingsystem (604) to execution of a new target executable process (602),changing from the block designated for the particular process to usingfor target code translation the translated code in the block of thetranslated code cache (610) designated as storage for the new targetexecutable process (602).

The example computer (152) includes two example NOCs capable ofimplementing emulation of a computer run time environment in accordancewith embodiments of the present invention: a video adapter (209) and acoprocessor (157). The video adapter (209) is an example of an I/Oadapter specially designed for graphic output to a display device (180)such as a display screen or computer monitor. Video adapter (209) isconnected to processor (156) through a high speed video bus (164), busadapter (158), and the front side bus (162), which is also a high speedbus.

The example NOC coprocessor (157) is connected to processor (156)through bus adapter (158), and front side buses (162 and 163), which isalso a high speed bus. The NOC coprocessor of FIG. 1 is optimized toaccelerate particular data processing tasks at the behest of the mainprocessor (156).

The example NOC video adapter (209) and NOC coprocessor (157) of FIG. 1each include a NOC according to embodiments of the present invention,including integrated processor (‘IP’) blocks, routers, memorycommunications controllers, and network interface controllers, each IPblock adapted to a router through a memory communications controller anda network interface controller, each memory communications controllercontrolling communication between an IP block and memory, and eachnetwork interface controller controlling inter-IP block communicationsthrough routers. The NOC video adapter and the NOC coprocessor areoptimized for programs that use parallel processing and also requirefast random access to shared memory. The details of the NOC structureand operation are discussed below with reference to FIGS. 2-4.

The computer (152) of FIG. 1 includes disk drive adapter (172) coupledthrough expansion bus (160) and bus adapter (158) to processor (156) andother components of the computer (152). Disk drive adapter (172)connects non-volatile data storage to the computer (152) in the form ofdisk drive (170). Disk drive adapters useful in computers for emulatinga computer run time environment according to embodiments of the presentinvention include Integrated Drive Electronics (‘IDE’) adapters, SmallComputer System Interface (‘SCSI’) adapters, and others as will occur tothose of skill in the art. Non-volatile computer memory also may beimplemented for as an optical disk drive, electrically erasableprogrammable read-only memory (so-called ‘EEPROM’ or ‘Flash’ memory),RAM drives, and so on, as will occur to those of skill in the art.

The example computer (152) of FIG. 1 includes one or more input/output(‘I/O’) adapters (178). I/O adapters implement user-orientedinput/output through, for example, software drivers and computerhardware for controlling output to display devices such as computerdisplay screens, as well as user input from user input devices (181)such as keyboards and mice.

The exemplary computer (152) of FIG. 1 includes a communications adapter(167) for data communications with other computers (182) and for datacommunications with a data communications network (100). Such datacommunications may be carried out serially through RS-232 connections,through external buses such as a Universal Serial Bus (‘USB’), throughdata communications data communications networks such as IP datacommunications networks, and in other ways as will occur to those ofskill in the art. Communications adapters implement the hardware levelof data communications through which one computer sends datacommunications to another computer, directly or through a datacommunications network. Examples of communications adapters useful foremulating a computer run time environment according to embodiments ofthe present invention include modems for wired dial-up communications,Ethernet (IEEE 802.3) adapters for wired data communications networkcommunications, and 802.11 adapters for wireless data communicationsnetwork communications.

For further explanation, FIG. 2 sets forth a functional block diagram ofan example apparatus useful in emulating a computer run time environmentaccording to embodiments of the present invention, a NOC (102). The NOCin the example of FIG. 1 is implemented on a ‘chip’ (100), that is, onan integrated circuit. The NOC (102) of FIG. 2 includes integratedprocessor (‘IP’) blocks (104), routers (110), memory communicationscontrollers (106), and network interface controllers (108). Each IPblock (104) is adapted to a router (110) through a memory communicationscontroller (106) and a network interface controller (108). Each memorycommunications controller controls communications between an IP blockand memory, and each network interface controller (108) controlsinter-IP block communications through routers (110).

In the NOC (102) of FIG. 2, each IP block represents a reusable unit ofsynchronous or asynchronous logic design used as a building block fordata processing within the NOC. The term ‘IP block’ is sometimesexpanded as ‘intellectual property block,’ effectively designating an IPblock as a design that is owned by a party, that is the intellectualproperty of a party, to be licensed to other users or designers ofsemiconductor circuits. In the scope of the present invention, however,there is no requirement that IP blocks be subject to any particularownership, so the term is always expanded in this specification as‘integrated processor block.’ IP blocks, as specified here, are reusableunits of logic, cell, or chip layout design that may or may not be thesubject of intellectual property. IP blocks are logic cores that can beformed as ASIC chip designs or FPGA logic designs.

One way to describe IP blocks by analogy is that IP blocks are for NOCdesign what a library is for computer programming or a discreteintegrated circuit component is for printed circuit board design. InNOCs according to embodiments of the present invention, IP blocks may beimplemented as generic gate netlists, as complete special purpose orgeneral purpose microprocessors, or in other ways as may occur to thoseof skill in the art. A netlist is a Boolean-algebra representation(gates, standard cells) of an IP block's logical-function, analogous toan assembly-code listing for a high-level program application. NOCs alsomay be implemented, for example, in synthesizable form, described in ahardware description language such as Verilog or VHDL. In addition tonetlist and synthesizable implementation, NOCs also may be delivered inlower-level, physical descriptions. Analog IP block elements such asSERDES, PLL, DAC, ADC, and so on, may be distributed in atransistor-layout format such as GDSII. Digital elements of IP blocksare sometimes offered in layout format as well.

Each IP block (104) in the example of FIG. 2 is adapted to a router(110) through a memory communications controller (106). Each memorycommunication controller is an aggregation of synchronous andasynchronous logic circuitry adapted to provide data communicationsbetween an IP block and memory. Examples of such communications betweenIP blocks and memory include memory load instructions and memory storeinstructions. The memory communications controllers (106) are describedin more detail below with reference to FIG. 3.

Each IP block (104) in the example of FIG. 2 is also adapted to a router(110) through a network interface controller (108). Each networkinterface controller (108) controls communications through routers (110)between IP blocks (104). Examples of communications between IP blocksinclude messages carrying data and instructions for processing the dataamong IP blocks in parallel applications and in pipelined applications.The network interface controllers (108) are described in more detailbelow with reference to FIG. 3.

Each IP block (104) in the example of FIG. 2 is adapted to a router(110). The routers (110) and links (120) among the routers implement thenetwork operations of the NOC. The links (120) are packets structuresimplemented on physical, parallel wire buses connecting all the routers.That is, each link is implemented on a wire bus wide enough toaccommodate simultaneously an entire data switching packet, includingall header information and payload data. If a packet structure includes64 bytes, for example, including an eight byte header and 56 bytes ofpayload data, then the wire bus subtending each link is 64 bytes wise,512 wires. In addition, each link is bi-directional, so that if the linkpacket structure includes 64 bytes, the wire bus actually contains 1024wires between each router and each of its neighbors in the network. Amessage can includes more than one packet, but each packet fitsprecisely onto the width of the wire bus. If the connection between therouter and each section of wire bus is referred to as a port, then eachrouter includes five ports, one for each of four directions of datatransmission on the network and a fifth port for adapting the router toa particular IP block through a memory communications controller and anetwork interface controller.

Each memory communications controller (106) in the example of FIG. 2controls communications between an IP block and memory. Memory caninclude off-chip main RAM (112), memory (115) connected directly to anIP block through a memory communications controller (106), on-chipmemory enabled as an IP block (114), and on-chip caches. In the NOC ofFIG. 2, either of the on-chip memories (114, 115), for example, may beimplemented as on-chip cache memory. All these forms of memory can bedisposed in the same address space, physical addresses or virtualaddresses, true even for the memory attached directly to an IP block.Memory addressed messages therefore can be entirely bidirectional withrespect to IP blocks, because such memory can be addressed directly fromany IP block anywhere on the network. Memory (114) on an IP block can beaddressed from that IP block or from any other IP block in the NOC.Memory (115) attached directly to a memory communication controller canbe addressed by the IP block that is adapted to the network by thatmemory communication controller—and can also be addressed from any otherIP block anywhere in the NOC.

The example NOC includes two memory management units (‘MMUs’) (107,109), illustrating two alternative memory architectures for NOCsaccording to embodiments of the present invention. MMU (107) isimplemented with an IP block, allowing a processor within the IP blockto operate in virtual memory while allowing the entire remainingarchitecture of the NOC to operate in a physical memory address space.The MMU (109) is implemented off-chip, connected to the NOC through adata communications port (116). The port (116) includes the pins andother interconnections required to conduct signals between the NOC andthe MMU, as well as sufficient intelligence to convert message packetsfrom the NOC packet format to the bus format required by the externalMMU (109). The external location of the MMU means that all processors inall IP blocks of the NOC can operate in virtual memory address space,with all conversions to physical addresses of the off-chip memoryhandled by the off-chip MMU (109).

In addition to the two memory architectures illustrated by use of theMMUs (107, 109), data communications port (118) illustrates a thirdmemory architecture useful in NOCs according to embodiments of thepresent invention. Port (118) provides a direct connection between an IPblock (104) of the NOC (102) and off-chip memory (112). With no MMU inthe processing path, this architecture provides utilization of aphysical address space by all the IP blocks of the NOC. In sharing theaddress space bi-directionally, all the IP blocks of the NOC can accessmemory in the address space by memory-addressed messages, includingloads and stores, directed through the IP block connected directly tothe port (118). The port (118) includes the pins and otherinterconnections required to conduct signals between the NOC and theoff-chip memory (112), as well as sufficient intelligence to convertmessage packets from the NOC packet format to the bus format required bythe off-chip memory (112).

In the example of FIG. 2, one of the IP blocks is designated a hostinterface processor (105). A host interface processor (105) provides aninterface between the NOC and a host computer (152) in which the NOC maybe installed and also provides data processing services to the other IPblocks on the NOC, including, for example, receiving and dispatchingamong the IP blocks of the NOC data processing requests from the hostcomputer. A NOC may, for example, implement a video graphics adapter(209) or a coprocessor (157) on a larger computer (152) as describedabove with reference to FIG. 1. In the example of FIG. 2, the hostinterface processor (105) is connected to the larger host computerthrough a data communications port (115). The port (115) includes thepins and other interconnections required to conduct signals between theNOC and the host computer, as well as sufficient intelligence to convertmessage packets from the NOC to the bus format required by the hostcomputer (152). In the example of the NOC coprocessor in the computer ofFIG. 1, such a port would provide data communications format translationbetween the link structure of the NOC coprocessor (157) and the protocolrequired for the front side bus (163) between the NOC coprocessor (157)and the bus adapter (158).

The exemplary NOC of FIG. 2 may implement emulation of a computer runtime environment in accordance with embodiments of the present inventionby executing a dynamic binary translation loop, a module of computerprogram instructions, stored in on-chip or off-chip memory, thatoperates in an emulation environment to translate target executable codecompiled for execution on a target computer to translated codeexecutable on a host computer of a kind other than the target computer,the target executable code comprising user-level application code andtarget operating system code, the target executable code comprisingtarget executable processes, the target operating system code effectingcontext switches among the target executable processes, the computerprogram instructions capable of: storing translated code in blocks of atranslated code cache, each block of the translated code cachedesignated for storage of translated code for a separate one of thetarget executable processes, including identifying each block independence upon an identifier of the process for which the block isdesignated as storage; executing by the emulation environment aparticular one of the target executable processes, using for target codetranslation the translated code in the block of the translated codecache designated as storage for the particular process; and uponencountering a context switch by the target operating system toexecution of a new target executable process, changing from the blockdesignated for the particular process to using for target codetranslation the translated code in the block of the translated codecache designated as storage for the new target executable process.

For further explanation, FIG. 3 sets forth a functional block diagram ofa further example apparatus useful in emulating a computer run timeenvironment according to embodiments of the present invention, anotherNOC (102). The example NOC of FIG. 3 is similar to the example NOC ofFIG. 2 in that the example NOC of FIG. 3 is implemented on a chip (100on FIG. 2), and the NOC (102) of FIG. 3 includes integrated processor(‘IP’) blocks (104), routers (110), memory communications controllers(106), and network interface controllers (108). Each IP block (104) isadapted to a router (110) through a memory communications controller(106) and a network interface controller (108). Each memorycommunications controller controls communications between an IP blockand memory, and each network interface controller (108) controlsinter-IP block communications through routers (110). In the example ofFIG. 3, one set (122) of an IP block (104) adapted to a router (110)through a memory communications controller (106) and network interfacecontroller (108) is expanded to aid a more detailed explanation of theirstructure and operations. All the IP blocks, memory communicationscontrollers, network interface controllers, and routers in the exampleof FIG. 3 are configured in the same manner as the expanded set (122).

In the example of FIG. 3, each IP block (104) includes a computerprocessor (126) and I/O functionality (124). In this example, computermemory is represented by a segment of random access memory (‘RAM’) (128)in each IP block (104). The memory, as described above with reference tothe example of FIG. 2, can occupy segments of a physical address spacewhose contents on each IP block are addressable and accessible from anyIP block in the NOC. The processors (126), I/O capabilities (124), andmemory (128) on each IP block effectively implement the IP blocks asgenerally programmable microcomputers. As explained above, however, inthe scope of the present invention, IP blocks generally representreusable units of synchronous or asynchronous logic used as buildingblocks for data processing within a NOC. Implementing IP blocks asgenerally programmable microcomputers, therefore, although a commonembodiment useful for purposes of explanation, is not a limitation ofthe present invention.

In the NOC (102) of FIG. 3, each memory communications controller (106)includes a plurality of memory communications execution engines (140).Each memory communications execution engine (140) is enabled to executememory communications instructions from an IP block (104), includingbidirectional memory communications instruction flow (142, 144, 145)between the network and the IP block (104). The memory communicationsinstructions executed by the memory communications controller mayoriginate, not only from the IP block adapted to a router through aparticular memory communications controller, but also from any IP block(104) anywhere in the NOC (102). That is, any IP block in the NOC cangenerate a memory communications instruction and transmit that memorycommunications instruction through the routers of the NOC to anothermemory communications controller associated with another IP block forexecution of that memory communications instruction. Such memorycommunications instructions can include, for example, translationlookaside buffer control instructions, cache control instructions,barrier instructions, and memory load and store instructions.

Each memory communications execution engine (140) is enabled to executea complete memory communications instruction separately and in parallelwith other memory communications execution engines. The memorycommunications execution engines implement a scalable memory transactionprocessor optimized for concurrent throughput of memory communicationsinstructions. The memory communications controller (106) supportsmultiple memory communications execution engines (140) all of which runconcurrently for simultaneous execution of multiple memorycommunications instructions. A new memory communications instruction isallocated by the memory communications controller (106) to a memorycommunications engine (140) and the memory communications executionengines (140) can accept multiple response events simultaneously. Inthis example, all of the memory communications execution engines (140)are identical. Scaling the number of memory communications instructionsthat can be handled simultaneously by a memory communications controller(106), therefore, is implemented by scaling the number of memorycommunications execution engines (140).

In the NOC (102) of FIG. 3, each network interface controller (108) isenabled to convert communications instructions from command format tonetwork packet format for transmission among the IP blocks (104) throughrouters (110). The communications instructions are formulated in commandformat by the IP block (104) or by the memory communications controller(106) and provided to the network interface controller (108) in commandformat. The command format is a native format that conforms toarchitectural register files of the IP block (104) and the memorycommunications controller (106). The network packet format is the formatrequired for transmission through routers (110) of the network. Eachsuch message is composed of one or more network packets. Examples ofsuch communications instructions that are converted from command formatto packet format in the network interface controller include memory loadinstructions and memory store instructions between IP blocks and memory.Such communications instructions may also include communicationsinstructions that send messages among IP blocks carrying data andinstructions for processing the data among IP blocks in parallelapplications and in pipelined applications.

In the NOC (102) of FIG. 3, each IP block is enabled to sendmemory-address-based communications to and from memory through the IPblock's memory communications controller and then also through itsnetwork interface controller to the network. A memory-address-basedcommunications is a memory access instruction, such as a loadinstruction or a store instruction, that is executed by a memorycommunication execution engine of a memory communications controller ofan IP block. Such memory-address-based communications typicallyoriginate in an IP block, formulated in command format, and handed offto a memory communications controller for execution.

Many memory-address-based communications are executed with messagetraffic, because any memory to be accessed may be located anywhere inthe physical memory address space, on-chip or off-chip, directlyattached to any memory communications controller in the NOC, orultimately accessed through any IP block of the NOC—regardless of whichIP block originated any particular memory-address-based communication.All memory-address-based communication that are executed with messagetraffic are passed from the memory communications controller to anassociated network interface controller for conversion (136) fromcommand format to packet format and transmission through the network ina message. In converting to packet format, the network interfacecontroller also identifies a network address for the packet independence upon the memory address or addresses to be accessed by amemory-address-based communication. Memory address based messages areaddressed with memory addresses. Each memory address is mapped by thenetwork interface controllers to a network address, typically thenetwork location of a memory communications controller responsible forsome range of physical memory addresses. The network location of amemory communication controller (106) is naturally also the networklocation of that memory communication controller's associated router(110), network interface controller (108), and IP block (104). Theinstruction conversion logic (136) within each network interfacecontroller is capable of converting memory addresses to networkaddresses for purposes of transmitting memory-address-basedcommunications through routers of a NOC.

Upon receiving message traffic from routers (110) of the network, eachnetwork interface controller (108) inspects each packet for memoryinstructions. Each packet containing a memory instruction is handed tothe memory communications controller (106) associated with the receivingnetwork interface controller, which executes the memory instructionbefore sending the remaining payload of the packet to the IP block forfurther processing. In this way, memory contents are always prepared tosupport data processing by an IP block before the IP block beginsexecution of instructions from a message that depend upon particularmemory content.

In the NOC (102) of FIG. 3, each IP block (104) is enabled to bypass itsmemory communications controller (106) and send inter-IP block,network-addressed communications (146) directly to the network throughthe IP block's network interface controller (108). Network-addressedcommunications are messages directed by a network address to another IPblock. Such messages transmit working data in pipelined applications,multiple data for single program processing among IP blocks in a SIMDapplication, and so on, as will occur to those of skill in the art. Suchmessages are distinct from memory-address-based communications in thatthey are network addressed from the start, by the originating IP blockwhich knows the network address to which the message is to be directedthrough routers of the NOC. Such network-addressed communications arepassed by the IP block through it I/O functions (124) directly to the IPblock's network interface controller in command format, then convertedto packet format by the network interface controller and transmittedthrough routers of the NOC to another IP block. Such network-addressedcommunications (146) are bi-directional, potentially proceeding to andfrom each IP block of the NOC, depending on their use in any particularapplication. Each network interface controller, however, is enabled toboth send and receive (142) such communications to and from anassociated router, and each network interface controller is enabled toboth send and receive (146) such communications directly to and from anassociated IP block, bypassing an associated memory communicationscontroller (106).

Each network interface controller (108) in the example of FIG. 3 is alsoenabled to implement virtual channels on the network, characterizingnetwork packets by type. Each network interface controller (108)includes virtual channel implementation logic (138) that classifies eachcommunication instruction by type and records the type of instruction ina field of the network packet format before handing off the instructionin packet form to a router (110) for transmission on the NOC. Examplesof communication instruction types include inter-IP blocknetwork-address-based messages, request messages, responses to requestmessages, invalidate messages directed to caches; memory load and storemessages; and responses to memory load messages, and so on.

Each router (110) in the example of FIG. 3 includes routing logic (130),virtual channel control logic (132), and virtual channel buffers (134).The routing logic typically is implemented as a network of synchronousand asynchronous logic that implements a data communications protocolstack for data communication in the network formed by the routers (110),links (120), and bus wires among the routers. The routing logic (130)includes the functionality that readers of skill in the art mightassociate in off-chip networks with routing tables, routing tables in atleast some embodiments being considered too slow and cumbersome for usein a NOC. Routing logic implemented as a network of synchronous andasynchronous logic can be configured to make routing decisions as fastas a single clock cycle. The routing logic in this example routespackets by selecting a port for forwarding each packet received in arouter. Each packet contains a network address to which the packet is tobe routed. Each router in this example includes five ports, four ports(121) connected through bus wires (120-A, 120-B, 120-C, 120-D) to otherrouters and a fifth port (123) connecting each router to its associatedIP block (104) through a network interface controller (108) and a memorycommunications controller (106).

In describing memory-address-based communications above, each memoryaddress was described as mapped by network interface controllers to anetwork address, a network location of a memory communicationscontroller. The network location of a memory communication controller(106) is naturally also the network location of that memorycommunication controller's associated router (110), network interfacecontroller (108), and IP block (104). In inter-IP block, ornetwork-address-based communications, therefore, it is also typical forapplication-level data processing to view network addresses as locationof IP block within the network formed by the routers, links, and buswires of the NOC. FIG. 2 illustrates that one organization of such anetwork is a mesh of rows and columns in which each network address canbe implemented, for example, as either a unique identifier for each setof associated router, IP block, memory communications controller, andnetwork interface controller of the mesh or x,y coordinates of each suchset in the mesh.

In the NOC (102) of FIG. 3, each router (110) implements two or morevirtual communications channels, where each virtual communicationschannel is characterized by a communication type. Communicationinstruction types, and therefore virtual channel types, include thosementioned above: inter-IP block network-address-based messages, requestmessages, responses to request messages, invalidate messages directed tocaches; memory load and store messages; and responses to memory loadmessages, and so on. In support of virtual channels, each router (110)in the example of FIG. 3 also includes virtual channel control logic(132) and virtual channel buffers (134). The virtual channel controllogic (132) examines each received packet for its assignedcommunications type and places each packet in an outgoing virtualchannel buffer for that communications type for transmission through aport to a neighboring router on the NOC.

Each virtual channel buffer (134) has finite storage space. When manypackets are received in a short period of time, a virtual channel buffercan fill up—so that no more packets can be put in the buffer. In otherprotocols, packets arriving on a virtual channel whose buffer is fullwould be dropped. Each virtual channel buffer (134) in this example,however, is enabled with control signals of the bus wires to advisesurrounding routers through the virtual channel control logic to suspendtransmission in a virtual channel, that is, suspend transmission ofpackets of a particular communications type. When one virtual channel isso suspended, all other virtual channels are unaffected—and can continueto operate at full capacity. The control signals are wired all the wayback through each router to each router's associated network interfacecontroller (108). Each network interface controller is configured to,upon receipt of such a signal, refuse to accept, from its associatedmemory communications controller (106) or from its associated IP block(104), communications instructions for the suspended virtual channel. Inthis way, suspension of a virtual channel affects all the hardware thatimplements the virtual channel, all the way back up to the originatingIP blocks.

One effect of suspending packet transmissions in a virtual channel isthat no packets are ever dropped in the architecture of FIG. 3. When arouter encounters a situation in which a packet might be dropped in someunreliable protocol such as, for example, the Internet Protocol, therouters in the example of FIG. 3 suspend by their virtual channelbuffers (134) and their virtual channel control logic (132) alltransmissions of packets in a virtual channel until buffer space isagain available, eliminating any need to drop packets. The NOC of FIG.3, therefore, implements highly reliable network communicationsprotocols with an extremely thin layer of hardware.

The exemplary NOC of FIG. 3, like the NOC of FIG. 2, may implementemulation of a computer run time environment in accordance withembodiments of the present invention by executing a dynamic binarytranslation loop, a module of computer program instructions, stored inon-chip or off-chip memory, that operates in an emulation environment totranslate target executable code compiled for execution on a targetcomputer to translated code executable on a host computer of a kindother than the target computer, the target executable code comprisinguser-level application code and target operating system code, the targetexecutable code comprising target executable processes, the targetoperating system code effecting context switches among the targetexecutable processes, the computer program instructions capable of:storing translated code in blocks of a translated code cache, each blockof the translated code cache designated for storage of translated codefor a separate one of the target executable processes, includingidentifying each block in dependence upon an identifier of the processfor which the block is designated as storage; executing by the emulationenvironment a particular one of the target executable processes, usingfor target code translation the translated code in the block of thetranslated code cache designated as storage for the particular process;and upon encountering a context switch by the target operating system toexecution of a new target executable process, changing from the blockdesignated for the particular process to using for target codetranslation the translated code in the block of the translated codecache designated as storage for the new target executable process.

For further explanation, FIG. 4 sets forth a flow chart illustrating anexemplary method for data processing with an example apparatus, a NOC,useful in emulating a computer run time environment according toembodiments of the present invention. The method of FIG. 4 isimplemented on a NOC similar to the ones described above in thisspecification, a NOC (102 on FIG. 3) that is implemented on a chip (100on FIG. 3) with IP blocks (104 on FIG. 3), routers (110 on FIG. 3),memory communications controllers (106 on FIG. 3), and network interfacecontrollers (108 on FIG. 3). Each IP block (104 on FIG. 3) is adapted toa router (110 on FIG. 3) through a memory communications controller (106on FIG. 3) and a network interface controller (108 on FIG. 3). In themethod of FIG. 4, each IP block may be implemented as a reusable unit ofsynchronous or asynchronous logic design used as a building block fordata processing within the NOC.

The method of FIG. 4 includes controlling (402) by a memorycommunications controller (106 on FIG. 3) communications between an IPblock and memory. In the method of FIG. 4, the memory communicationscontroller includes a plurality of memory communications executionengines (140 on FIG. 3). Also in the method of FIG. 4, controlling (402)communications between an IP block and memory is carried out byexecuting (404) by each memory communications execution engine acomplete memory communications instruction separately and in parallelwith other memory communications execution engines and executing (406) abidirectional flow of memory communications instructions between thenetwork and the IP block. In the method of FIG. 4, memory communicationsinstructions may include translation lookaside buffer controlinstructions, cache control instructions, barrier instructions, memoryload instructions, and memory store instructions. In the method of FIG.4, memory may include off-chip main RAM, memory connected directly to anIP block through a memory communications controller, on-chip memoryenabled as an IP block, and on-chip caches.

The method of FIG. 4 also includes controlling (408) by a networkinterface controller (108 on FIG. 3) inter-IP block communicationsthrough routers. In the method of FIG. 4, controlling (408) inter-IPblock communications also includes converting (410) by each networkinterface controller communications instructions from command format tonetwork packet format and implementing (412) by each network interfacecontroller virtual channels on the network, including characterizingnetwork packets by type.

The method of FIG. 4 also includes transmitting (414) messages by eachrouter (110 on FIG. 3) through two or more virtual communicationschannels, where each virtual communications channel is characterized bya communication type. Communication instruction types, and thereforevirtual channel types, include, for example: inter-IP blocknetwork-address-based messages, request messages, responses to requestmessages, invalidate messages directed to caches; memory load and storemessages; and responses to memory load messages, and so on. In supportof virtual channels, each router also includes virtual channel controllogic (132 on FIG. 3) and virtual channel buffers (134 on FIG. 3). Thevirtual channel control logic examines each received packet for itsassigned communications type and places each packet in an outgoingvirtual channel buffer for that communications type for transmissionthrough a port to a neighboring router on the NOC.

FIG. 5 sets forth a block diagram of an exemplary computing environment(200) useful for emulating a computer run time environment according toembodiments of the present invention. Emulation as the term is used inthis specification refers to the imitation of one computer, the targetcomputer, by another computer, the host computer. The term ‘target’ asused in this specification refers to a subject of emulation, while theterm ‘host’ refers to a computing environment in which emulation iscarried out. A target computer, target executable code, target run timeenvironments, target operating systems, and so on, for example, may beemulated on a host computer running a host operating system and a hostrun time environment.

The exemplary computer environment (200) of FIG. 5 includes four layersof software, modules of computer program instructions, running on a hostcomputer (152), automated computing machinery. The lowest layer (216) ofsoftware depicted in the exemplary computing environment (200) of FIG. 5is a host operating system (154). Examples of host operating systems incomputing environments (200) useful for emulating a computer run timeenvironment according to embodiments of the present invention includeUNIX™, Linux™, Microsoft XP™, AIX™, IBM's i5/OS™, and others as willoccur to those of skill in the art.

Operating at a layer (214) above the host operating system (154), in theexemplary computing environment (200) of FIG. 5, is a host run timeenvironment (208). A run time environment is a virtual machine statewhich provides software services for processes or programs while acomputer is running.

Operating at a layer above the exemplary host run time environment (208)of FIG. 5 is an emulated computer run time environment (206) for atarget computer. Such an emulated computer run time environment (206)for a target computer is a run time environment for software originallyintended to be executed upon a target computer. By analogy, an emulatedcomputer run time environment is to target software what a host run timeenvironment is to host software.

The exemplary emulated computer run time environment (206) of FIG. 5includes a binary translation loop (502). Binary translation is theemulation of one instruction set by another through translation of code.In binary translation, computer program instructions are translated froma target instruction set to a host instruction set. In dynamictranslation code is translated as it discovered during execution of thecode in an emulated computer run time environment. Dynamic translationtypically includes translating a short sequence of code such as, forexample, a single basic block, and caching the resulting translatedsequence for execution in the emulated computer run time environment. Abasic block of code may be a sequence of instructions with a singleentry point, single exit point, and no internal branches.

The exemplary dynamic binary translation loop (502) of FIG. 5 is amodule of computer program instructions that translates targetexecutable code (504) compiled for execution on a target computer tocode executable on a host computer (152) of a kind other than the targetcomputer. Such target executable code (504) is depicted in the exampleof FIG. 5 as executing at a layer (210) above the emulated computer runtime environment (206). The target executable code (504) includesuser-level application code (606) and target operating system code(604). Examples of target operating systems in computing environments(200) useful for emulating a computer run time environment according toembodiments of the present invention include UNIX™, Linux™, MicrosoftXP™, AIX™, IBM's i5/OS™, and others as will occur to those of skill inthe art. Each of the target operating system code (604) and theuser-level application code (606) includes a target executable process(602). The target operating system code (604) effects context switchesamong the target executable processes (602).

The binary translation loop (502) operates generally for emulating acomputer run time environment in accordance with embodiments of thepresent invention. During execution, and translation, of the targetexecutable code (504), the binary translation loop (502) may carry outemulation of a computer run time environment by: storing translated codein blocks (612) of a translated code cache (610), each block (612) ofthe translated code cache (610) designated for storage of translatedcode for a separate one of the target executable processes (602),including identifying each block (612) in dependence upon an identifierof the process (602) for which the block (612) is designated as storage.The emulation environment may then execute a particular one of thetarget executable processes (602), using for target code translation thetranslated code in the block (612) of the translated code cache (610)designated as storage for the particular process (602) and uponencountering a context switch by the target operating system (604) toexecution of a new target executable process (602), changing from theblock (612) designated for the particular process (602) to using fortarget code translation the translated code in the block (612) of thetranslated code cache (610) designated as storage for the new targetexecutable process (602).

FIG. 6 sets forth a flow chart illustrating an exemplary method foremulating a computer run time environment according to embodiments ofthe present invention. The method of FIG. 6 is implemented as acomponent of a dynamic binary translation loop (502), a module ofcomputer program instructions, that operates in an emulation environmentto translate target executable code (504) compiled for execution on atarget computer to translated code (632) executable on a host computerof a kind other than the target computer.

Emulation as the term is used in this specification refers to theimitation of one computer, the target computer, by another computer, thehost computer. The term ‘target’ as used in this specification refers toa subject of emulation, while the term ‘host’ refers to a computingenvironment in which emulation is carried out. A target computer, targetexecutable code, target run time environments, target operating systems,and so on, for example, may be emulated on a host computer running ahost operating system and a host run time environment.

Binary translation is the emulation of one instruction set by anotherthrough translation of code. In binary translation, computer programinstructions are translated from a target instruction set to a hostinstruction set. There are two types of binary translation, static anddynamic. In static binary translation, an entire executable file istranslated prior to execution of the file into an executable file of thehost architecture. In dynamic translation, by contrast, code istranslated as it discovered during execution of the code in an emulatedcomputer run time environment. Dynamic translation typically includestranslating a short sequence of code such as, for example, a singlebasic block, and caching the resulting translated sequence for executionin the emulated computer run time environment. A basic block of code maybe a sequence of instructions with a single entry point, single exitpoint, and no internal branches.

In the method of FIG. 6, the target executable code (504) includesuser-level application code (606) and target operating system code(604). In addition, the target executable code (504) includes targetexecutable processes (602). In the example of FIG. 6 each of the targetoperating system code (604) and the user-level application code (606)includes a target executable process (602) for clarity, not forlimitation. Readers of skill in the art will recognize that the targetoperating system code (604) and the user-level application code (606)may include any number of target executable processes in accordance withembodiments of the present invention.

The method of FIG. 6 includes storing (614) translated code (632) inblocks (612) of a translated code cache (610). Each block (612) of theexample cache (610) of FIG. 6 is designated for storage of translatedcode (632) for a separate one of the target executable processes (602).In the method of FIG. 6 storing (614) translated code (632) in blocks(612) of a translated code cache (610) includes identifying (616) eachblock in dependence upon an identifier (630) of the process (602) forwhich the block (612) is designated as storage.

A translated code cache is a data structure in which translated targetexecutable code is stored for later use in emulating a computer run timeenvironment. Such a translated code cache enables emulation of a runtime environment that is more efficient than emulation that includestranslated the same target code multiple times. A block in a translatedcode cache is a segment of computer memory in which translated code fora particular target executable process is stored. In the example of FIG.6 the translated code cache is implemented as a table having a column ofidentifications (630) of processes (602) and a column of translated code(632) for each process. Each record of the table is a block (612) in thetranslated code cache (610) and associates an identifier of a processwith translated code for that processes. The example translated codecache (610) of FIG. 6 is depicted as a table for clarity only. Readersof skill in the art will recognize, however, that a translated codecache (610) according to embodiments of the present invention may beimplemented as any data structure, such as an array, a linked list, andso on.

In the method of FIG. 6, identifying (616) each block in dependence uponan identifier (630) of the process (602) for which the block (612) isdesignated as storage may include identifying (618) each block with ahash of the process identifier and a target virtual memory address oridentifying (620) each block using the process identifier as an indexinto the translated code cache.

The method of FIG. 6 also includes executing (622) by the emulationenvironment (206 on FIG. 5) a particular one of the target executableprocesses (602), using for target code translation the translated code(632) in the block (612) of the translated code cache (610) designatedas storage for the particular process (634). Consider for example thatthe target executable process (602) of the user-level application code(606) in FIG. 6 is the process identified in the translated code cache(610) of FIG. 6 as ‘Proc_1.’ Executing (622), by the emulationenvironment (206 on FIG. 5), ‘Proc_1’ may be carried out using thetranslated code (632) in the block (612) designated as storage for theparticular process (634), that is, the translated code (632) associatedwith the process identification ‘Proc_1.’

Upon encountering a context switch (624) by the target operating system(604) to execution of a new target executable process (636), the methodof FIG. 6 continues by changing (626) from the block (612) designatedfor the particular process (634) to using for target code translationthe translated code (632) in the block (612) of the translated codecache (610) designated as storage for the new target executable process(636). A context switch is the computing process of storing andrestoring the state, or context, of a processor such that multipleprocesses can share a single processor resource. The context switch isan essential feature of a multitasking operating system. A contextswitch can mean a register context switch, a task context switch, athread context switch, or a process context switch. What constitutes thecontext is determined by the processor and the operating system.

Consider, for example, a context switch (624) by the target operatingsystem (604) to execution of the processes identified in the translatedcode cache as ‘Proc_2,’ that is, switching from execution of ‘Proc_1’ toexecution of ‘ Proc_2.’ Upon such a context switch, the method of FIG. 6includes changing (626) from the block (612) designated for ‘Proc_1’ tousing for target code translation the translated code (632) in the block(612) of the translated code cache (610) designated as storage for the‘Proc_2’.

Changing (626) from the block (612) designated for the particularprocess (634) to using for target code translation the translated code(632) in the block (612) of the translated code cache (610) designatedas storage for the new target executable process (636) may be carriedout by changing (628) from the block (612) designated for the particularprocess (634) to using for target code translation the translated codein the block of the translated code cache designated as storage for thenew target executable process (636) without flushing any portion of thetranslated code cache (610), including preserving the contents of theblocks (612) between context switches (624). The effect of preservingcontents of the blocks (612) in a translated code cache (610) betweencontext switches is that efficiency in executing of the targetexecutable code in the emulation environment is increased because thereis no need to re-translate previously translated and stored code for apreviously executed target executable process.

Exemplary embodiments of the present invention are described largely inthe context of a fully functional computer system for emulating acomputer run time environment. Readers of skill in the art willrecognize, however, that the present invention also may be embodied in acomputer program product disposed on signal bearing media for use withany suitable data processing system. Such signal bearing media may betransmission media or recordable media for machine-readable information,including magnetic media, optical media, or other suitable media.Examples of recordable media include magnetic disks in hard drives ordiskettes, compact disks for optical drives, magnetic tape, and othersas will occur to those of skill in the art. Examples of transmissionmedia include telephone networks for voice communications and digitaldata communications networks such as, for example, Ethernets™ andnetworks that communicate with the Internet Protocol and the World WideWeb as well as wireless transmission media such as, for example,networks implemented according to the IEEE 802.11 family ofspecifications. Persons skilled in the art will immediately recognizethat any computer system having suitable programming means will becapable of executing the steps of the method of the invention asembodied in a program product. Persons skilled in the art will recognizeimmediately that, although some of the exemplary embodiments describedin this specification are oriented to software installed and executingon computer hardware, nevertheless, alternative embodiments implementedas firmware or as hardware are well within the scope of the presentinvention.

It will be understood from the foregoing description that modificationsand changes may be made in various embodiments of the present inventionwithout departing from its true spirit. The descriptions in thisspecification are for purposes of illustration only and are not to beconstrued in a limiting sense. The scope of the present invention islimited only by the language of the following claims.

What is claimed is:
 1. A method of emulating a computer run timeenvironment, the method implemented as a component of a dynamic binarytranslation loop that operates in an emulation environment to translatetarget executable code compiled for execution on a target computer totranslated code executable on a host computer of a kind other than thetarget computer, the target executable code comprising user-levelapplication code and target operating system code, the target executablecode comprising target executable processes, the target operating systemcode effecting context switches among the target executable processes,the method comprising: storing translated code in blocks of a translatedcode cache, each block of the translated code cache designated forstorage of translated code for a separate one of the target executableprocesses, including identifying each block in dependence upon anidentifier of the process for which the block is designated as storage;executing by the emulation environment a particular one of the targetexecutable processes, using for target code translation the translatedcode in the block of the translated code cache designated as storage forthe particular process; and upon encountering a context switch by thetarget operating system from execution of the particular one of thetarget executable processes to execution of a new target executableprocess, changing from the block designated for the particular processto using for target code translation the translated code in the block ofthe translated code cache designated as storage for the new targetexecutable process, wherein the method is implemented on a network onchip (‘NOC’), the NOC comprising integrated processor (‘IP’) blocks,routers, memory communications controllers, and network interfacecontroller, each IP block connected to a router through a memorycommunications controller and a network interface controller, eachmemory communications controller controlling communication between an IPblock and memory, and each network interface controller controllinginter-IP block communications through routers, wherein each routerimplements a plurality of virtual communications channels, the virtualcommunications channels characterized by different communication types.2. The method of claim 1 wherein identifying each block in dependenceupon an identifier of the process for which the block is designated asstorage further comprises: identifying each block with a hash of theprocess identifier and a target virtual memory address.
 3. The method ofclaim 1 wherein identifying each block in dependence upon an identifierof the process for which the block is designated as storage furthercomprises: identifying each block using the process identifier as anindex into the translated code cache.
 4. The method of claim 1 whereinchanging from the block designated for the particular process to usingfor target code translation the translated code in the block of thetranslated code cache designated as storage for the new targetexecutable process further comprises: changing from the block designatedfor the particular process to using for target code translation thetranslated code in the block of the translated code cache designated asstorage for the new target executable process without flushing anyportion of the translated code cache, including preserving the contentsof the blocks between context switches.
 5. The method of claim 1 whereineach IP block comprises a reusable unit of synchronous or asynchronouslogic design used as a building block for data processing within theNOC.
 6. An apparatus for emulating a computer run time environment, theapparatus comprising a computer processor, a computer memory operativelycoupled to the computer processor, the computer memory having disposedwithin it computer program instructions implemented as a component of adynamic binary translation loop that operates in an emulationenvironment to translate target executable code compiled for executionon a target computer to translated code executable on a host computer ofa kind other than the target computer, the target executable codecomprising user-level application code and target operating system code,the target executable code comprising target executable processes, thetarget operating system code effecting context switches among the targetexecutable processes, the computer program instructions upon executioncauses the apparatus to perform the steps of: storing translated code inblocks of a translated code cache, each block of the translated codecache designated for storage of translated code for a separate one ofthe target executable processes, including identifying each block independence upon an identifier of the process for which the block isdesignated as storage; executing by the emulation environment aparticular one of the target executable processes, using for target codetranslation the translated code in the block of the translated codecache designated as storage for the particular process; and uponencountering a context switch by the target operating system fromexecution of the particular one of the target executable processes toexecution of a new target executable process, changing from the blockdesignated for the particular process to using for target codetranslation the translated code in the block of the translated codecache designated as storage for the new target executable process,wherein the apparatus further comprises a network on chip (‘NOC’), theNOC comprising integrated processor (‘IP’) blocks, routers, memorycommunications controllers, and network interface controller, each IPblock connected to a router through a memory communications controllerand a network interface controller, each memory communicationscontroller controlling communication between an IP block and memory, andeach network interface controller controlling inter-IP blockcommunications through routers, wherein each router implements aplurality of virtual communications channels, the virtual communicationschannels characterized by different communication types.
 7. Theapparatus of claim 6 wherein identifying each block in dependence uponan identifier of the process for which the block is designated asstorage further comprises: identifying each block with a hash of theprocess identifier and a target virtual memory address.
 8. The apparatusof claim 6 wherein identifying each block in dependence upon anidentifier of the process for which the block is designated as storagefurther comprises: identifying each block using the process identifieras an index into the translated code cache.
 9. The apparatus of claim 6wherein changing from the block designated for the particular process tousing for target code translation the translated code in the block ofthe translated code cache designated as storage for the new targetexecutable process further comprises: changing from the block designatedfor the particular process to using for target code translation thetranslated code in the block of the translated code cache designated asstorage for the new target executable process without flushing anyportion of the translated code cache, including preserving the contentsof the blocks between context switches.
 10. The apparatus of claim 6wherein each IP block comprises a reusable unit of synchronous orasynchronous logic design used as a building block for data processingwithin the NOC.
 11. A computer program product for emulating a computerrun time environment, the computer program product disposed in anon-transitory computer-readable medium, the computer program productcomprising computer program instructions implemented as a component of adynamic binary translation loop that operates in an emulationenvironment to translate target executable code compiled for executionon a target computer to translated code executable on a host computer ofa kind other than the target computer, the target executable codecomprising user-level application code and target operating system code,the target executable code comprising target executable processes, thetarget operating system code effecting context switches among the targetexecutable processes, the computer program instructions upon executioncauses a computer to perform the steps of: storing translated code inblocks of a translated code cache, each block of the translated codecache designated for storage of translated code for a separate one ofthe target executable processes, including identifying each block independence upon an identifier of the process for which the block isdesignated as storage; executing by the emulation environment aparticular one of the target executable processes, using for target codetranslation the translated code in the block of the translated codecache designated as storage for the particular process; and uponencountering a context switch by the target operating system fromexecution of the particular one of the target executable processes toexecution of a new target executable process, changing from the blockdesignated for the particular process to using for target codetranslation the translated code in the block of the translated codecache designated as storage for the new target executable process,wherein the computer program instructions are capable of execution on anetwork on chip (‘NOC’), the NOC comprising integrated processor (‘IP’)blocks, routers, memory communications controllers, and networkinterface controller, each IP block connected to a router through amemory communications controller and a network interface controller,each memory communications controller controlling communication betweenan IP block and memory, and each network interface controllercontrolling inter-IP block communications through routers, wherein eachrouter implements a plurality of virtual communications channels, thevirtual communications channels characterized by different communicationtypes.
 12. The computer program product of claim 11 wherein identifyingeach block in dependence upon an identifier of the process for which theblock is designated as storage further comprises: identifying each blockwith a hash of the process identifier and a target virtual memoryaddress.
 13. The computer program product of claim 11 whereinidentifying each block in dependence upon an identifier of the processfor which the block is designated as storage further comprises:identifying each block using the process identifier as an index into thetranslated code cache.
 14. The computer program product of claim 11wherein changing from the block designated for the particular process tousing for target code translation the translated code in the block ofthe translated code cache designated as storage for the new targetexecutable process further comprises: changing from the block designatedfor the particular process to using for target code translation thetranslated code in the block of the translated code cache designated asstorage for the new target executable process without flushing anyportion of the translated code cache, including preserving the contentsof the blocks between context switches.
 15. The computer program productof claim 11 wherein each IP block comprises a reusable unit ofsynchronous or asynchronous logic design used as a building block fordata processing within the NOC.